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AMENDMENTS TO THE CLAIMS 

Claims 10, 11, 15, 17, 18, 20, 22, 24-28, and 30-37 are pending in the subject 
application. Each of claims 10, 27, 28, and 36 has been amended herein. This Listing of Claims 
will replace all prior versions, and listings, of claims in the application. 

Listing of Claims 

1-9. (Canceled) 

10. (Currently Amended) A computer-implemented method of capturing and 
treating content using a computer system having a processor, memory, and data storage 
subsystems, the computer-implemented method comprising: 

a) setting a mode of operation to a content capture mode for interpreting 
user input for the purpose of selecting an on-screen region of a display, and 
receiving a path drawn by a user, the path defining boundaries of the selected on- 
screen region of the display, wherein pixels comprising one or more graphical 
elements representing a first set of one or more textual characters are displayed in 
the selected on-screen region; 

b) capturing the pixels displayed within the selected on-screen region, and 
storing the captured pixels in an image file; 

c) switching the mode of operation to an annotation mode in response to a 
user command; 

d) receiving an annotation drawn by the user on the display, wherein the 
received annotation is implemented using a plurality of tools via a toolbar, the 
toolbar appearing after the selecting an on-screen region; 
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e) obtaining context information for the one or more graphical elements by 
automatically applying text recognition to the annotation, and storing the results 
of the text recognition as context information via the computer system , wherein 
certain context information is prevented from associating with the one or more 
graphical elements based upon digital rights management preventive measures , 
and 

f) obtaining additional context information by extracting the first set of 
one or more textual characters and extracting a second set of textual characters 
displayed in proximity with the first set, 

wherein the context information and the additional context information are 
automatically stored in association with the image file. 

11. (Previously Presented) The computer-implemented method 
according to claim 10, further comprising: 

determining a window associated with the selected on-screen region; 

retrieving an application interface having a Uniform Resource Identifier 
(URI) property from the determined window or a parent window of the 
determined window; and 

obtaining the URI property as additional context information, the 
additional context information being automatically stored in association with the 
image file. 

12-14. (Canceled) 
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15. (Previously Presented) The computer- implemented method of claim 10, 
further comprising: 

creating and storing a linking structure as the association between the 
image file and the context information. 

16. (Canceled) 

17. (Previously Presented) The computer-implemented method of claim 
15, wherein the linking structure is incorporated in a file separate from the stored image file and 
the stored context information. 

18. (Previously Presented) The computer-implemented method of claim 
15, wherein the linking structure includes at least one pointer pointing to the stored image file or 
the stored context information. 

19. (Canceled) 

20. (Previously Presented) The computer-implemented method of claim 
10, wherein the context information is stored in such a manner as to be accessible to the user for 
performing at least one of the following: 

searching for said context information, 

displaying the context information simultaneously with the captured 
pixels, and navigating a network to a source of the captured image pixels. 

21. (Canceled) 
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22. (Previously Presented) The computer-implemented method of claim 
10, wherein the selected on-screen region is part of a displayed textual region, and the graphical 
elements comprise a first set of one or more textual characters displayed in the textual region, 
and the method further comprising: 

obtaining additional context information based on a second set of one or 
more textual characters displayed in the textual region, the additional context 
information being automatically stored in association with the image file; and 

obtaining a first pointer between the context information and the textual 
region, and obtaining a second pointer between the additional context information 
and the textual region, wherein the first pointer differs from the second pointer. 

23. (Canceled) 

24. (Previously Presented) The computer-implemented method of claim 
27, further comprising: 

digitizing movements of a stylus across the display in order to receive an 
annotation; and 

obtaining additional context information based on the received annotation, 
the additional context information being automatically stored in association with 
the image file. 

25. (Previously Presented) The computer- implemented method of claim 
10, wherein the selected on-screen region includes at least a portion of a displayed web page or 
document, and the method further comprises: 
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using an application programming interface (API) to query an application 
for additional context information, the additional context information being 
automatically stored in association with the image file, the queried application 
causing the one or more graphical elements to be displayed. 

26. (Previously Presented) The computer- implemented method of claim 
25, further comprising: obtaining a uniform resource identifier (URI) of the web page or 
document as the context information, the URI being obtained as a result of the query using the 
API. 

27. (Currently Amended) A computer-implemented method of context 
harvesting from selected content using a computer system having a processor, memory, and data 
storage subsystems, the method: 

receiving a path drawn on a display via user input the drawn path defining 
boundaries of a selected on-screen region of the display, the selected on-screen 
region comprising a plurality of pixels , wherein a displayed content of the 
selected on screen region includes textual data and underlying data comprising at 
least one of: an executable object, a file, or a link to remote content ; 

capturing the plurality of pixels and associated underlying text and 
associated links to embedded information of the on-screen region by capturing 
only complete characters or words ; 

storing the captured pixels as an image file; 

automatically extracting a character or word from the textual data and 
extracting complete sentences based upon punctuation as context information in 
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response to determining that the displayed content of the on-screen region 
includes the textual data via the computer system; 

pointing a first pointer from the context information to the displayed 
content; 

automatically extracting a property of the underlying data as additional 
context information in response to determining that the displayed content of the 
on-screen region includes the underlying data via the computer system, the 
property comprising at least one of: a file name, a file identifier, a uniform 
resource locator (URL), a uniform resource identifier (URI), a folder name, or 
meta-data; 

pointing a second pointer from the additional context information to the 
displayed content; and 

storing the extracted context information and additional context 
information in association with the image file via the data storage subsystem, such 
that the context information is accessible when viewing the image file. 

28. (Currently Amended) A computer-implemented method of context 
harvesting from selected content using a computer system having a processor, memory, and data 
storage subsystems, the method comprising: 

receiving a display of content comprising at least one of textual data, an 
executable object, a file, or a link to remote content; 

setting a mode of operation to a content capture mode; 
receiving a path drawn on the display which defines boundaries of a 
selected on-screen region of the content via user input; 
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capturing and storing the selected content as an image file via the data 
storage subsystem; 

switching the mode of operation to an annotation mode; 

receiving an annotation on the display via the user input; 

performing text recognition on the received annotation as context 
information; 

pointing a first pointer from the selected content to the context 
information; 

automatically determining via the computer system that the content 
displayed within the on-screen region includes textual data and underlying data; 
automatically extracting as additional context information: 

a bounded region comprising a character or word from the textual 
data determined to be included in the on-screen region, and determining if the 
character or word lies completely within the bounded region, [[and]] 

a property of the underlying data determined to be included in the 
on-screen region, the property comprising at least one of: a file name, a file 
identifier, a uniform resource locator (URL), a uniform resource identifier (URI), 
a folder name, or meta-data , and 

a separate linking structure comprising identifying information 
which relates the selected content to the context information ; 

pointing a second pointer from the selected content to the additional 
context information; and 
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storing the context information and the additional context information in 
association with the image file via the data storage subsystem, such that the 
context information is accessible when viewing the image file. 

29. (Canceled) 

30. (Previously Presented) The computer-implemented method of claim 
10, wherein the annotation is stored as originally drawn as additional context information in 
association with the image file. 

3 1 . (Previously Presented) The computer-implemented method of claim 
28, wherein the annotation is stored as originally drawn as additional context information in 
association with the image file. 

32. (Previously Presented) The computer-implemented method of claim 
10, further comprising a link to the one or more graphical elements of the selected on-screen 
region, the link comprising one of an implicit link hidden behind the one or more graphical 
elements and an explicit link shown in conjunction with the one or more graphical elements. 

33. (Previously Presented) The computer-implemented method of claim 
10, further comprising a separate linking table or database entry utilizing one or more pointers to 
the one or more graphical elements. 

34. (Previously Presented) The computer-implemented method of claim 
10, further comprising displaying the obtained context information to the user as one of 
displaying a property in a window and hovering over the one or more graphical elements. 
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35. (Previously Presented) The computer- implemented method of claim 
10, wherein the one or more graphical elements comprise underlying data, underlying objects, 
and underlying associations with remote content. 

36. (Currently Amended) The computer-implemented method of claim 10 
[[21]], further comprising: determining that the second sets of textual characters reside within the 
path drawn by the user and any subsequent sets of textual characters reside outside the path 
drawn by the user. 

37. (Previously Presented) The computer-implemented method of claim 
10, wherein the received annotation is implemented using a plurality of tools via a toolbar, the 
toolbar appearing after a stylus has been lifted off the display. 
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